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(54) INTER-FRAME PREDICTIVE CODING SYSTEM 

(57)Abstract: 

PURPOSE: To attain prediction adaptive to the change 
of a picture and to improve coding efficiency by 
predicting the signal of a non-independent frame based 
on a predictive signal corresponding to the signal and 
executing coding for the predicted error. 
CONSTITUTION: When the signal of a moving picture 
inputted from a picture signal input terminal 1 is the 
signal of the non-independent frame, changeover 
switches 37 and 38 are connected to a (b) side, and the 
signal is delayed by (N-1) frames in an (N~1) frame 
memory 31. Further, after the predicted signal is 
subtracted in a predicted signal subtracter 2, the signal 
is guided to an orthogonal transformer 3, and the coding 
is executed for the predicted error of the signal. The 
signal of the non-independent frame is delayed by the 
memory 31, and the picture signal of an independent 
frame used for the prediction is stored by frame 
memories 32 and 33 by 2 frames before prediction 
processing for the non-independent frame is executed. 

Thus, the predictive signal can be obtained from front and rear (new and old) frames. 
Consequently, the prediction adaptive to the change of the picture can be executed, and the 
coding efficiency can be improved. 
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FIG. 3 shows a prediction signal adder 41 for adding a 
prediction signal to a signal obtained from an orthogonal 
inverse transformer 24. 

Further, since the prediction signal is generated based 
5 on the previous and next two frames, two frame memories 42, 

43 and two coefficient multipliers {xa, x(l-a)} 44, 45 and 
an adder 46 for these components are provided. 

Further, a switch 47 is provided between the orthogonal 
inverse transformer 24 and the prediction signal adder 41, a 
10 switch 48 is provided between the prediction signal adder 41 

and a reproduction image signal output terminal 26, and a 
switch 49 is provided between two frame memories 42, 43. 

In the structure of the embodiment shown in FIG. 1, by 
the switches 37, 38, a video image signal (continuous 
15 frames) inputted from the image signal input terminal 1 is 

connected to the "a" side in the frames encoded 
independently, and guided to the orthogonal transformer 3 
without passing through the (N-l) frame memory 31 and the 
prediction signal subtracter 2. 
20 The orthogonal transformer 3, the quantizer 4, and the 

variable length encoder 5 are basically operated in the same 
manner as in the case of the conventional example. 

Since the remaining non-independent frames are 
predicted by inter-frame prediction, subtraction of the 
25 prediction signal is performed. In the method of the 

present invention, the independent frames need to be encoded 
beforehand. Therefore, the remaining frames are delayed 
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correspondingly . 

Assuming that every N frames includes one independent 
frame [N is an integer number of 2 or more], the delay 
amount corresponds to (N-l) frames. That is, during the 
5 non-independent frames, the switches 37, 3 8 are connected to 

the "b" side, and the signal is delayed by the (N-l) frame 
memory 31 by the delay corresponding to the (N-l) frames. 
Then, after subtraction of the prediction signal is 
performed by the prediction signal subtracer 2, the 
10 prediction signal is guided to the orthogonal transformer 3, 

and the prediction error (residual) of the prediction signal 
is encoded. 

The switches 37, 38 are connected to the u a" side 
periodically, in one frame of every N frames. In the other 

15 frames, the switches 37, 38 are connected to the w b" side. 

The subsequent operations of the orthogonal transformers 3, 
the quantizer 4, and the variable length encoder 4 are the 
same as in the case of the independent frame. The same 
operations as described above are carried out in the encoder 

20 according to another embodiment in FIG. 2. 

In the case of the encoder having the structure as 
shown in FIG. 2, the prediction signal is not obtained from 
the encoding reproduction image signal, but obtained from 
the original image signal before encoding. Operation at the 

25 time of generating the prediction signal is the same as in 

the case of FIG. 1 except that the original image is 
inputted instead of the encoding reproduction image signal. 
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In the structure of FIG. 2, the inverse quantizer 7 and 
the orthogonal inverse transformer 8 in FIG. 1 are not 
required. In this case, though the prediction signal on the 
transmission side is different from the prediction signal on 
5 the receiver side, in the method of the present invention, 

the error will not be accumulated in each of the frames. 
Rather, since the quantization error does not remain in the 
prediction error (residue) , spatial LPC in the conventional 
example is not required. Accordingly, improvement in the 

10 prediction efficiency is achieved. 

Next, a method of generating a prediction signal in the 
method of the present invention will be described. Firstly, 
as an example, a case of obtaining the same prediction 
signal in both of the encoder side and the decoder side as 

15 in the case of the conventional example is illustrated in 

FIG. 1. In the conventional example, all of the frames are 
used for obtaining the prediction signal. In contrast, in 
the method of the present invention, the prediction signal 
is generated only based on the independent frames that have 

20 been encoded independently. Therefore, the switch 39 is 

connected to the "a" side only in the independent frames, 
and then, the subsequent operations are performed. In this 
respect, the method of the present invention is different 
from the conventional example. 

25 The quantized signal is replaced by a representative 

value (representative value setting) by the inverse 
quantizer 7 as in the case of the conventional example. 
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Then, the orthogonal inverse transformer 8 performs inverse 
processing of orthogonal transformation. 

Since the signal obtained as described above is encoded 
independently, the signal is not added to the previous frame 
or the like, and directly written in the frame memory 32 to 
use it for generation of the prediction signal. At this 
time, the switch 40 is connected to the "a" side and the 
signal of the previous independent frame stored in the frame 
memory 32 is stored into the frame memory 33 for 
replacement. By the operation as described above, the 
reproduction frame signals used in the prediction 
concurrently with encoding of the independent frames is 
prepared in the frame memories 32, 33. 

The reproduction frame signals are kept stored until 
the signal of the next independent frame is supplied. For 
the prediction process, the reproduction frame signals are 
outputted repeatedly (N-l) times. 

The prediction signal is obtained by multiplying the 
two reproduction frame signals by the weighting coefficients 
a and (1-a) by the multiplier 34, 35, and adding the signals 
by the adder 3 6 . 

The weighting coefficients are determined based on the 
relationship between the frames inputted to the prediction 
signal subtracter 2 for encoding the frames, and the frame 
used for prediction. The most common approach adopts a 
method based on the second order linear prediction given by 
the following equation: 
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a= (m - mp) /N 

where m denotes an encoding target frame number (1, 2, 
3, ...) , mp denotes a prior independent frame number (0, N, 
2N, ... ), and m > Mp. N is an integer number of 2 or more. 
5 An example of the prediction signal (prediction value) 

as generated above in a case where N = 4 is shown in FIG. 7. 
In this manner, heavy weighting is applied to the temporally 
nearest frame, and in particular, when the signal is changed 
substantially linearly in each frame, a suitable prediction 

10 value can be provided. 

In FIGS. 1 and 2 as described above, in the input image 
signal, an independent frame is obtained in every several 
frames by the switches 37, 38, and inter- frame correlation 
of the encoded data is interrupted. Therefore, by random 

15 accessing in the unit of several frames, or decoding of only 

data of the independent frames, visual searching can be 
performed. 

Before the signal of the non-independent frame is 
delayed by the (N-l) frame memory 31, and the prediction 

20 process of the non-independent frame is performed, the image 

signals of two independent frames is stored in the frame 
memories 32, 33. Thus, the prediction signal can be 
obtained from the next and previous (new and old) frames. 

Further, by multiplication of the suitable coefficient 

25 based on the temporal relationship between the predicted 

frame and the independent frame by the coefficient 
multipliers 34, 35, it becomes possible to perform 
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prediction matching the change in the image. Since 
improvement in the S/N of the prediction signal is achieved, 
the prediction efficiency becomes high. 

Further, since the encoding data obtained in this 
5 manner has symmetrical structure on the time axis, reverse 

reproduction can be performed easily. 

Next, the process on the decoder side will be 
described. In the structure of the embodiment shown in FIG. 
3, firstly, as in the case of the conventional example, 
10 variable length digital data inputted from the data input 

terminal 21 is handled by the variable length encoder 22, 
the reverse quantizer 23, and the orthogonal inverse 
transformer 24. Thus, in the independent frame, the 
reproduction image signal is obtained, and in the non- 
15 independent frame, the prediction error (residual) is 

obtained. Since the signal of the independent frame is used 
for prediction, the switch 47 is connected to the "a" side, 
and data is written in the frame memory 42. At this time, 
the switches 48, 49 are also connected to the w a" side. The 
20 signal of the previous independent frame is stored in the 

frame memory 43 for replacement, and outputted from the 
reproduction image output terminal 2 6 at the same time. As 
described above, the reproduction frame signals used for 
prediction concurrently with decoding of the independent 
25 frame are prepared in the frame memories 42, 43. 

At the time of processing the reproduction prediction 
error (residual) signal based on the non-independent frame, 
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the switches 44, 45 are connected to the w b" side, and the 
prediction signal (prediction value) same as the prediction 
signal on the encoder side is added by the prediction value 
signal adder 41, and the resulting signal is outputted to 
the reproduction image output terminal 26. Further, the 
method of generating the prediction signal using the 
coefficient multiplier 44, 45, and the adder 46 is the same 
as in the case of the encoder side. 

As for the data transmitted from the encoder side, 
since the data of the independent frame is transmitted 
beforehand, on the decoder side, in order to correct the 
transmitted data, the reproduction image signal of the 
independent frame is outputted from the frame memory 42 when 
the prediction process is finished. That is, the frame 
memory 42 is also used for time correction. 
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